The effect of hearing aid dynamic range compression on speech intelligibility in a realistic virtual sound environment.

Measures of "aided" speech intelligibility (SI) for listeners wearing hearing aids (HAs) are commonly obtained using rather artificial acoustic stimuli and spatial configurations compared to those encountered in everyday complex listening scenarios. In the present study, the effect of hearing aid dynamic range compression (DRC) on SI was investigated in simulated real-world acoustic conditions. A spatialized version of the Danish Hearing In Noise Test was employed inside a loudspeaker-based virtual sound environment to present spatialized target speech in background noise consisting of either spatial recordings of two real-world sound scenarios or quadraphonic, artificial speech-shaped noise (SSN). Unaided performance was compared with results obtained with a basic HA simulator employing fast-acting DRC. Speech reception thresholds (SRTs) with and without DRC were found to be significantly higher in the conditions with real-world background noise than in the condition with artificial SSN. Improvements in SRTs caused by the HA were only significant in conditions with real-world background noise and were related to differences in the output signal-to-noise ratio of the HA signal processing between the real-world versus artificial conditions. The results may be valuable for the design, development, and evaluation of HA signal processing strategies in realistic, but controlled, acoustic settings.

Guided ecological momentary assessment in real and virtual sound environments.

Ecological momentary assessment (EMA) outcome measures can relate people's subjective auditory experience to their objective acoustical reality. While highly realistic, EMA data often contain considerable variability, such that it can be difficult to interpret the results with respect to differences in people's hearing ability. To address this challenge, a method for "guided" EMA is proposed and evaluated. Accompanied and instructed by a guide, normal-hearing participants carried out specific passive and active listening tasks inside a real-world public lunch scenario and answered EMA questionnaires related to aspects of spatial hearing, listening ability, quality, and effort. In situ speech and background noise levels were tracked, allowing the guided EMA task to be repeated inside two acoustically matched, loudspeaker-based laboratory environments: a 64-channel virtual sound environment (VSE) and a three-channel audiology clinic setup. Results showed that guided EMA provided consistent passive listening assessments across participants and conditions. During active listening, the clinic setup was found to be less challenging than the real-world and the VSE conditions. The proposed guided EMA approach may provide more focused real-world assessments and can be applied in realistic laboratory settings to aid the development of ecologically valid hearing testing.

Speech intelligibility in a realistic virtual sound environment.

In the present study, speech intelligibility was evaluated in realistic, controlled conditions. "Critical sound scenarios" were defined as acoustic scenes that hearing aid users considered important, difficult, and common through ecological momentary assessment. These sound scenarios were acquired in the real world using a spherical microphone array and reproduced inside a loudspeaker-based virtual sound environment (VSE) using Ambisonics. Speech reception thresholds (SRT) were measured for normal-hearing (NH) and hearing-impaired (HI) listeners, using sentences from the Danish hearing in noise test, spatially embedded in the acoustic background of an office meeting sound scenario. In addition, speech recognition scores (SRS) were obtained at a fixed signal-to-noise ratio (SNR) of -2.5 dB, corresponding to the median conversational SNR in the office meeting. SRTs measured in the realistic VSE-reproduced background were significantly higher for NH and HI listeners than those obtained with artificial noise presented over headphones, presumably due to an increased amount of modulation masking and a larger cognitive effort required to separate the target speech from the intelligible interferers in the realistic background. SRSs obtained at the fixed SNR in the realistic background could be used to relate the listeners' SI to the potential challenges they experience in the real world.

A method for realistic, conversational signal-to-noise ratio estimation.

The analysis of real-world conversational signal-to-noise ratios (SNRs) can provide insight into people's communicative strategies and difficulties and guide the development of hearing devices. However, measuring SNRs accurately is challenging in everyday recording conditions in which only a mixture of sound sources can be captured. This study introduces a method for accurate in situ SNR estimation where the speech signal of a target talker in natural conversation is captured by a cheek-mounted microphone, adjusted for free-field conditions and convolved with a measured impulse response to estimate its power at the receiving talker. A microphone near the receiver provides the noise-only component through voice activity detection. The method is applied to in situ recordings of conversations in two real-world sound scenarios. It is shown that the broadband speech level and SNR distributions are estimated more accurately by the proposed method compared to a typical single-channel method, especially in challenging, low-SNR environments. The application of the proposed two-channel method may render more realistic estimates of conversational SNRs and provide valuable input to hearing instrument processing strategies whose operating points are determined by accurate SNR estimates.

The impact of reverberation on speech intelligibility in cochlear implant recipients.

Listening to speech in an environment with reverberation can be challenging for both the normal and impaired auditory system. However, it has been shown for both normal- and impaired-hearing listeners that it is the late reflections that are responsible for degrading intelligibility, whereas early reflections actually aid intelligibility by increasing the effective signal-to-noise ratio. Contrastingly, studies conducted with cochlear implant (CI) recipients have suggested that CI recipients have almost no tolerance for reverberation and that they are negatively impacted by both early and late reflections. The main objective of the current study is to re-evaluate the influence of reverberation on speech intelligibility in CI recipients using more authentic virtual auditory environments. Unlike previous studies in this area, this study was conducted using a loudspeaker-based auralization system rather than non-individualized binaural room simulations. Speech intelligibility was measured in simulations of a range of actual physical rooms with plausible source-receiver distances, both with and without late reflections. The results show that the effect of reverberation is much smaller than previously suggested, especially with short source-receiver distances. Furthermore, the results suggest that, in contrast to previous literature, early reflections may not actually be detrimental to CI recipients.

The effect of nearby maskers on speech intelligibility in reverberant, multi-talker environments.

The extent to which informational masking (IM) is involved in real-world listening is not well understood. In the literature, IM effects of more than 8 dB are reported, but these experiments typically used simplified spatial configurations and speech materials with exaggerated confusions. Westermann and Buchholz [(2015b). J. Acoust. Soc. Am. 138, 584-593] considered a simulated cafeteria and found only substantial IM effects when the target and maskers were colocated and the same talker. The present study further investigates the relevance of IM in real-world environments, specifically distractions by nearby maskers and the effect of hearing impairment. Speech reception thresholds (SRTs) were measured with normal hearing (NH) and sensorineural hearing impaired (HI) listeners in a simulated cafeteria environment. Three different masker configurations were considered: (1) seven dialogues distributed in the cafeteria, (2) two monologues presented close to the listener with varying angular separation, and (3) a combination of (1) and (2). The contribution of IM was measured as the difference in SRTs between speech maskers and unintelligible vocoded maskers. No significant IM was found with the seven dialogues alone. Including nearby maskers resulted in substantial IM for both NH and HI listeners, suggesting that such maskers might result in IM in real-world environments.

Cochlear implant speech intelligibility outcomes with structured and unstructured binary mask errors.

It has been shown that intelligibility can be improved for cochlear implant (CI) recipients with the ideal binary mask (IBM). In realistic scenarios where prior information is unavailable, however, the IBM must be estimated, and these estimations will inevitably contain errors. Although the effects of both unstructured and structured binary mask errors have been investigated with normal-hearing (NH) listeners, they have not been investigated with CI recipients. This study assesses these effects with CI recipients using masks that have been generated systematically with a statistical model. The results demonstrate that clustering of mask errors substantially decreases the tolerance of errors, that incorrectly removing target-dominated regions can be as detrimental to intelligibility as incorrectly adding interferer-dominated regions, and that the individual tolerances of the different types of errors can change when both are present. These trends follow those of NH listeners. However, analysis with a mixed effects model suggests that CI recipients tend to be less tolerant than NH listeners to mask errors in most conditions, at least with respect to the testing methods in each of the studies. This study clearly demonstrates that structure influences the tolerance of errors and therefore should be considered when analyzing binary-masking algorithms.

The influence of informational masking in reverberant, multi-talker environments.

The relevance of informational masking (IM) in real-world listening is not well understood. In literature, IM effects of up to 10 dB in measured speech reception thresholds (SRTs) are reported. However, these experiments typically employed simplified spatial configurations and speech corpora that magnified confusions. In this study, SRTs were measured with normal hearing subjects in a simulated cafeteria environment. The environment was reproduced by a 41-channel 3D-loudspeaker array. The target talker was 2 m in front of the listener and masking talkers were either spread throughout the room or colocated with the target. Three types of maskers were realized: one with the same talker as the target (maximum IM), one with talkers different from the target, and one with unintelligible, noise-vocoded talkers (minimal IM). Overall, SRTs improved for the spatially distributed conditions compared to the colocated conditions. Within the spatially distributed conditions, there was no significant difference between thresholds with the different- and vocoded-talker maskers. Conditions with the same-talker masker were the only conditions with substantially higher thresholds, especially in the colocated conditions. These results suggest that IM related to target-masker confusions, at least for normal-hearing listeners, is of low relevance in real-life listening.

The effect of spatial separation in distance on the intelligibility of speech in rooms.

The influence of spatial separation in source distance on speech reception thresholds (SRTs) is investigated. In one scenario, the target was presented at 0.5 m distance, and the masker varied from 0.5 m distance up to 10 m. In a second scenario, the masker was presented at 0.5 m distance and the target distance varied. The stimuli were synthesized using convolution with binaural room impulse responses (BRIRs) measured on a dummy head in a reverberant auditorium, and were equalized to compensate for distance-dependent spectral and intensity changes. All sources were simulated directly in front of the listener. SRTs decreased monotonically when the target was at 0.5 m and the speech-masker was moved further away, resulting in a SRT improvement of up to 10 dB. When the speech masker was at 0.5 m and the target was moved away, a large variation across subjects was observed. Neither short-term signal-to-noise ratio (SNR) improvements nor cross-ear glimpsing could account for the observed improvement in intelligibility. However, the effect might be explained by an improvement in the SNR in the modulation domain and a decrease in informational masking. This study demonstrates that distance-related cues can play a significant role when listening in complex environments.

Binaural dereverberation based on interaural coherence histograms.

A binaural dereverberation algorithm is presented that utilizes the properties of the interaural coherence (IC) inspired by the concepts introduced in Allen et al. [J. Acoust. Soc. Am. 62, 912-915 (1977)]. The algorithm introduces a non-linear sigmoidal coherence-to-gain mapping that is controlled by an online estimate of the present coherence statistics. The algorithm automatically adapts to a given acoustic environment and provides a stronger dereverberation effect than the original method presented in Allen et al. [J. Acoust. Soc. Am. 62, 912-915 (1977)] in most acoustic conditions. The performance of the proposed algorithm was objectively and subjectively evaluated in terms of its impacts on the amount of reverberation and overall quality. A binaural spectral subtraction method based on Lebart et al. [Acta Acust. Acust. 87, 359-366 (2001)] and a binaural version of the original method of Allen et al. were considered as reference systems. The results revealed that the proposed coherence-based approach is most successful in acoustic scenarios that exhibit a significant spread in the coherence distribution where direct sound and reverberation can be segregated. This dereverberation algorithm is thus particularly useful in large rooms for short source-receiver distances.